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Field o i tr.e Invention 

The present invent ion relates to a method for 
recording a bar code according to the preamble to 
claim 1, a reading device for re tor ding a bar code 
acccrdmg to the preamble to claim 13, and a storage 
medium according to the preamble to claim 16. 
Background Art 

Bar codes are today used to a great extent in the 
industry, trade and other branches of business. They 
constitute a possibility of rationally identifying an 
object and recording an object passing a certain point. 
Several standards for bar codes are already established, 
such as EAN, UPC etc. 

A number of variants of bar code readers are pre- 
sently available. The simplest type of bar code reader 
is the point sensor. A point sensor is passed by the use] 
across the base, on which the bar code is printed. 
tO'int sensor then records the bar code as a variation 



motion is very high for this type c: sensor/ many reading 
attempts will fail. Tine most reliable metncd of achieving 
an even speed as the sensor is being moved across the 
base is to move the sensor quickly. A user who has been 
unsuccessful m a first reading will, however, probably 
make the next reading more slowly since a slew reading is 
intuitively perceived as more accurate. The use of the 
point sensor as a bar code reader is thus associated with 
some p rob 1 ems , which makes its usability 1 lmi ted . 

Another known method is to use an elongate sensor. 



T f- 



nay 



■insist of a row of juxtaposed CCD pixels (CCD 



Charge Coupled Device) . These absorb light from a surface 
which is illuminated by a row of light -emitting diodes. 
This sensor is not passed across the bar code but is kept 
stationary over the same, all lines in the cede being 
re: cr de d simu 1 1 anecusly . 

A d r a v;b ack of the elongate sensor, in addition to 
its hicher price, is that it cannot record bar cedes of 



which sweeo a laser neam ever a car ceoe . ±r.e receive a 
Light: is orojecceo once a point: sensor. 

The drawback of this type of bar code reader is 
above alL a high price. However, the movable optics are 
also very susceptible to shocks, which restricts the 
usability of this bar code reader. 
Summary o»f the Invention 

An object of the present invention is to wholly or 
partly remedy the above problems. 

Th i s obj ect is achieved by a method for recording 
a bar code according to claim 1, a reading device for 
recording a bar code according to claim 13 and a storage 
medium according to claim 16. 

Ac c c r d i ng to a first aspect of the i n ve n tier, t he 
above object is achieved more specifically by a method 
for recordina a bar code which consists of a plurality 



or uaraiiex 



;f varyma tmcKness . Tne metnoc corn- 



er i s e s tne s t e o s o t : 



d) determining the most probable sequence of dis- 
* the seauence c: images; and 

e) reconstructing the bar code by means cf said 
seauence of images and said most probable sequence of 
displacements . 

3y means of such a method, a bar code can be inter- 
oreted m a very reliable manner. The reading device can 
be moved across the bar code in an arbitrary fashion as 
lone as the entire bar code is recorded. The speed of 
the motion mav vary from immobile up to the s pee id at 
which two success ive images do not overlap each other 
any longer. Bar codes of an arbitrary length can be 
recorded. The reading device can be accomplished at a 
ve r v low cost. Merely by a dd i ng new s o f t ware to a read- 
ing pen of the type as disclosed in Applicant's Patent 
SE 533,357, C2 , and used to record text, a reading device 
for interpretation of bar codes can be accomplished. A 
o e r s o n wh o for o t he r n urn o s e s owns such a reading pen car. 
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P r e f e r a b 1 v scec b ) ; 

bl^ generating, for 
/hich represent pares :>f 
respond inn c 3 the 



crises the foil owing steps 
least a subset of the imac 
& b a " v " ~* o g. e a n 1 s t go r a m c o _ 
arhness level in said oixel alone: < 



b2 ) d 1 f t e rent 1 a 1 1 ng saia nisccgram so tnat a 
sequen :e of edge coordinates is provided , which describe 
where along said band in the image the edges of the lines 
of the bar code are located. This results m a more reli- 
able detection of the oar code. 

According to a preferred embodiment , differentiated 
histograms are generated for a plurality of bands extend - 



ma ove r an imaqe a: 



erent angles, tne oana wnose 



selectea a 



o g r a m s n a v e tne n 1 g n e s t pea.<s c e 1 n g 
.d v;hich is essentially nercendicular 
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e x t c - 



c i a t e d histograms . This allows more exact: detection of 
:he edges of the bar code. 

Preferably possible displacements are determined 
in steo c) by assuming such a displacement that two edge 
coordinates belonging to successive images correspond to 
e a ch ot he r , and then determining whether the remaining 
edge ooord mates in the images correspond to each ether . 
This enables quick and exact detection of conceivable 
displacements . 

The most probable sequence of displacements is 
determined preferably with a criterion based on lew acce- 
leration of the reading device . This enables reliable 
detect i on of the bar code . 

Preferably, error functions are determined in step 
d) for the images in which edges have been detected, for 
at least a subset of the conceivable displacements rela- 
tive to the displacements of a preceding image . Thi s 
makes it possible to determine a most probable displace- 



v, - = steed of the reading device when the preced- 
ing image was captured if the displacement of the preced- 
ing image is val id , 

- steed of the reading d e v ice w h en the image 
m question v;as captured if the displacement cf the image 
i n que s 1 1 on is va lid, 

a y _- = acceleration of the reading device when the 
preceding image was captured i f the di sp la cement of the 
ere reding image is va lid, 

a.. = acceleration cf the reading device when the 
imaae in quest ion was captured i f the displacement of the 
image in quest ion i s va lid. 

Such an error fun :ti:n has been f sund very rel i able . 

For the last image in the image sequence, the dis- 
placement relative to displacements of the preceding 
imaae , which has the lowest error function, is suitably 
selected as the most probable displacement . This results 
in more reliable detection cf the bar ccce. 




means f or capturing a sequence cf two- dir.er.sicnal images 
of the bar code when moving the reading device across the 
same , means for detect mg the edges of the bar cede m 
at least a subset of the images , me ans for determining 
possible displacements m relation to the edges of a pre- 
ceding image for the edges of at least a subset of the 
detested imaqes, means for determining the most probable 
seauence of displacements for the sequence of images, and 
means for reconstructing the bar code by means of said 
sequence of images and said most probable sequence cf 
d i sp 1 a cement s . 

The reading device involves advantages corresponding 
to those of the above - described method and can be varied 
corresoondinqly. Then the reading device generally com- 
prises means for carrying cut the steps defined in the 
method. 

According to a preferred embodiment, the reading 
device can be m eluded m a reading pen. Tne reading 
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ccmrising a computer program for recording a car ccae, 
which :onsists of a plurality of parallel lines of vary- 
ing thi :kness . The program comprises instructions for 

a 1 cart ur i ng bv means of a re a d i ng device a sequence 
of two-dimensional images of the bar code when moving the 
reading devi :e across the same / 

b i detecting the edges of the oar code in at least a 
subset of t he images ; 

c .) det ermm mg possible displacements in relation to 
the e does of a o receding imaoe for the edges of at least 
a subset of the detected images; 

d) determining the most probable sequence of dis- 
placements for the sequence of images; and 

e < reconstructing the bar code by means of said 
sequence of images and said most probable sequence of 
displacements . 

This computer program involves advantages corre- 
sponding to those of the above - described method and can 
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4a shows an image c f a h a r c o 
^ h - 4 o s h C ; w h i s t o o r 3. m s f cr 
the bar code image in Fig. 4a. 

Figs 5a - 5b show differentiated hi s t o grams corre- 
sponding to the histograms in Figs 4c and 4b, respec- 
tively . 

Fig . 5c shows an enlarged detail from the histogram 
in Fig. 5a. 

Figs 5a- 6d show how conceivable displacements 
between two successive images are determined. 

Fig . 7 is a diagram of a sequence of possible dis- 
placements between a sequence of images. 

Fi3. 8a and Fia. 5b show an example of inputting of 



'notion of Preferred 
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diment also be used for inputting cf tex: . The reading 
device 10 D can also be integrated with ether equipment, 
such as mobile telephones, FDA's, digital cameras etc. 

^ one short side cf the c a s i ng there is s vend cw 
102 which is to abut against or be held at a short dis- 
tance from the base from which reading is intended to 
occur. The width and height of the window 102 essentially 
conform with the surface reproduced by the reading device 
100 as an image is being captured. The window 102 forms 
an acute angle to the longitudinal axis of the casing 
of the reading device, so that the user of the reading 
device 100 is made to hold the reading device 100 at a 
certain predetermined angle to the base. The window 102 
is s 1 i ah 1 1 v retracted into the c a s i ng 101 in order net to 
be warn against the base in the use of the reading device 
100 . 

The rasing contains essentially an optics part 103, 
an electronic circuitry part 104 and a power supply part 




1C7 is to project: an image of the pare of the base posi- 
tioned under the w i n do w 103 on the light-sensitive sen- 
sor 103. The light-sensitive sensor is preferably a two- 
dimensional CZCD sensor with a built-in A/D converter. 

The power supply unit 105 comprises a battery 112 
which is mounted in the casing 101 . 

The electronic circuitry part 104 comprises a pro- 
cessor and data memories for processing images record- 
ed by the light-sensitive sensor 108. A reading device 
according to the invention comprises means for carrying 
out the method steps that will be described below. These 
means suitably consist of said processor and memories 
provided with appropriate software. Fart of or the entire 
recording method may also be carried out by means of an 
ASIC circuit . 

The inventive storage medium can consist of one of 
the above-mentioned memories m the reading device but 
can also be another storage medium, such as a diskette 
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in a crererrea 
The orccess : 



across wnicn i ^ i 
me n: the image f r e qu t 
:he method cf the present invention is carried cut thus 
>-.=. c e i ve s an even f I 3 f i mage s . The images can c e stored 
m a memory m the rea jing device . Fi rs t the recording of 
all pictures :an thus occur, after which the images are 
interpreted according to the present invention. According 
co the invent ion the interpret at ion can also be begun as 
soon as the first image has been captured. 

The reading device can be used for other purposes 
than entering of bar codes; for instance text, digits 
and other types of symbols can be entered. When the pro- 
cess through which the inventive method is carried out 
2 01 (see Fig. 2a) an image, it is checked 2 02 



wh ether the received i m. 



ie . 



This check can be carried cut relative to a set 
srion. For instance, it is possible to identify the 



o ixei s .ocatea m tne eages 



mes , i.e. o^ack 



:s rows/ columns 



for recjanizing a bar :oae ran aiso ce usea separately i 
other applications than in tne method according to the 
ere sent invent ion . 

If the cattured i r t a a e does not describe a bar code, 
it is tj be orocessed 2 0 3 in another manner . This may 
imply , for example , that re ::rd:ng of text occurs accord 
mg to what is known from Applicant's Patent SE 509,372, 
C2 . If tne captured image describes a bar code, it is to 
be croces sed as the first image in a sequence of images 
describing the bar code . 

First, a number of histograms 204 (see Figs 4b, 
4c) are generated, which describe the darkness level of 
the oixels along a number of bands 401, 402 etc. (see 
F :a . 4a), of a certain width, which bands extend over 
the ima zre 4 j 3 at different angl e s. Preferably, the ban as 
intersect an area tlose the center of the image. A band 
4 02 extending perpendicular to the 




aram is here generally meant a logic structure, such as a 
vector, which describes the darkness degree in different 
positions along the length of the band. In tact, tne 
histogram need normally not be printed, but is here shown 
only for descriptive purposes. 

With reference once more to Fig. 2a, the above gene- 
rated histograms are differentiated 205, i.e. on the 
basis of each histogram a new histogram is generated, 
which describes the difference in level between two 
neighboring points in the previously generated histogram. 
Figs 5a and 5b show differentiated histograms correspond- 
ing to those in Figs 4c and 4b, respectively. 

Using a criterion which takes the height of the 
peaks in these differentiated histograms into considera- 
tion, the differentiated histogram corresponding to the 
most perpendicular band over the bar oode is selected 
206, with reference once more to Fig. 2a. For example, 
the sum of the square of the values of the differentiated 
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white no macK. As accears 



represents a transition 
from rig. 5c, this peak consists of three successive 
ba rs 5 j 1 , 5 02 



.03. An 
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:imation c; 



deqree 



max i mum :: t n i s 
approximation of the second degree is calculated. The 
edge of the line can now be assumed to be very close to 
this maximum and is thus determined on the sub-pixel 
level, i.e. with a higher resolution than the resolution 
of the pixels. By carrying out such interpolations of all 
peaks in the selected differentiated histogram., a set of 
edae coordinates i s obtained , where the position of the 
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banc is most exact ^v aet ermine a. 



By edges is generally meant transitions from white to 



- 1 a ok and vice 



o t e r 



The set of edge coordinates can be made as an up/ 



histograms f :r a iarge number of bands at airrerent 
angles over the image. If the image frequency is 50 Hz, 
only 2 1 m.s have passed since the pre reding im.age was cap - 
t ured , and therefore it can be assumed that the angle cf 
t he re adi na devi re t c the base has not changed to any 
considerable extent . Therefore only histograms for three 
different bands are generated, one at the angle which in 
t he preceding image was found to be essentially perpend i - 
cular to the direct ion of extension o f the I ines of the 
bar code, and two bands angled at, for example, +2° and 
-2 C (one turn - 360°) relative to this band. This results 
in quicker data processing for images following the first 
image . 

These three histograms are differentiated 210 and 
the histogram having the highest peaks is selected as 
the most teroend i tular . In the same way as for the first 
i mage , i nt erpo lation 211 is carried out t o de t ermine the 
position of the edges of the lines of the bar code in the 
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to black) in the preceding image 606 which is furthest tc 
the right can be set as a reference point. The up- 
coordinates 602/ 603 , 604 etc. of the subsequent image 
then provide proposals for displacements Al, A2 , A3, A4 
of the reading device to the right . For each of these 
proposals, it is decided whether down- coordinates and 
the other up - coordinates coincide. In that case, this 
displacement is conceivable. 

In Fig. 6a, the up - coordinate of the later image 
which is positioned furthest to the left is assumed to 
conform with the up - coordinate of the preceding image 606 
furthest to the right, which results in a displacement 
(or cff set) Al . Then also the down- coordinate which is 
furthest to the right in the preceding image 606 conforms 
with the down- coordinate which is positioned furthest to 
the left in the later image 605. No other coordinates are 
positioned within the overlap of the images, the size of 
the overlap being determined by the displacement . Al 



At t he same t i me , t he t v; o up - coordinates wh ich are p c s i - 
:ioned furthest to the right in the preceding image 606 
conform with the two up- coordinates which are positioned 
furthest to the left in the later image 605. A2 therefore 
is a conceivable displacement. 

In Fig. 6c, the up- coordinate of the later image 
which is positioned furthest to the left but two is 
assumed to conform with the up- coordinate of the pre- 
ceding image 606 furthest to the right, which gives the 
displacement A3. Then also- the three down- coordinates 
w T hich are positioned furthest to the right in the preced- 
ing image 606 conform with the three down- coordinates 
which are positioned furthest to the left in the later 
image 605. At the same time the three up - coordinates 
which are positioned furthest to the right in the pre- 
ceding image 6 06 conform w T ith the three up - coordinates 
which are positioned furthest to- the left in the later 
image 605. Therefore A3 is a conceivable displacement. 
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The diagrams in Figs ca-6d are shown only for 
descriptive purposes; m the inventive method the data 
of the images is processed as sets of coordinates. Then 
a certain degree of displacement is added to the coordi- 
nates which correspond to the later image. Whether the 
displacement is conceivable or not is determined accord- 
ing to a certain criterion. For instance, the square sum 
of deviations in pairs of up and down coordinates of the 
overlapping parts of each image can be calculated (for 
instance, the difference between the coordinate value 
of the lowest up - coordinate in the overlapping part of 
the first image and the coordinate value of the lowest 
up - coordinate in the overlapping part of the later 
image) . If the square sum of these deviations is below 
a certain value, the displacement is assumed to be pos- 
sible . 

To be able to detect also motions from the left to 
the right, also the corresponding method can be carried 



recording of the bar code nas been terminated and :ha: 
the final processing is to cake place as will be describ- 
ed below with reference to rig. 2c. 

If, however, valid displacements exist, there is 
determined 214 for each of these an error function with 
regard to each of the displacements of the preceding 
image. This is shown in Fig. 7. Between the first image 
701 and the second image 702 there is a set 703 of con- 
ceivable displacements, in this case one to the right 
which gives a displacement value above the time axis and 
one to the left which gives a displacement below the 
axis, i.e. negative displacement. Also between the second 
image 702 and the third image 704 there is a set 705 of 
conceivable displacements which comprises two values. 
However, both are positive, which corresponds to motions 
of the reading device to the right at different soeeds . 
For all displacements between the preceding and subse- 
quent images in the sequence, error functions are deter - 

and the third 7G4 image, error functions are determined 




wherein 

e.. - = error function of the displacement of a pre- 
ceding image , 

v.. , = speed of the reading device when the preced- 
ing image was captured if the displacement of the preced- 
i ng i mage is valid, 

= speed of the reading device when the image 
in question was captured if the displacement of the image 
in quest ion is val id , 

a,. - = acceleration of the reading device when the 
preceding image was captured if the displacement of the 
preceding image is valid, and 

a-, = acceleration of the reading device when the 
image in question was captured if the displacement of the 
image in question is valid. 

If the difference in the speed required for the 
displacement of the preceding image to be valid and the 
speed required for the displacement of the image in ques - 
z i on ; and the displacement c f the preceding image- to be 
v a 1 i d i s g r ea: , a n a mo r o .. v e r t h • - c c r r e s ; different e 

in a z z e "L e r a t i o n is ares". , a are a t e r r z r is - i v — r , since 
this is a motion which is improbable for the reading 
device. Even if the differences in steed and acceleraticn 



nun±er ) perpendicular to the 1 ines of the bar code 
between two captured images . 

For each conceivable displacement in an image, the 
displacement cf the preceding image which has the lowest 
error function is selected (Fig. 2b, 215) as the most 
probable preceding displacement. For the greatest con- 
ceivable displacement 706 between the second 7 02 and the 
third 704 image, for instance the positive displacement 
707 (i.e. to the right) between the first 701 and the 
second 7 02 image is selected as the most probable preced- 
ing displacement . 

Subsequently the process is repeated, once more with 
reference to Fig. 2b, when the next image is received 
208 . 

When the process establishes 216 that no conce ivable 
displacements relative to the preceding image exist for 
an arrived image, the scanned bar code is finally pro- 
cessed, as will be described in mo re detail with refe- 



:ne ^ast image aescriomg tne oar ccae , it is establish- 
ed 2 17 which disci a cement relative to d i so 1 a cement s of 



each image has a most probable preceding displacement, a 
chain of most probable displacements for the ent ire image 
sequence can now be created 218. 

This chain (709 m Fig. 7) of most probable dis- 
olacements forms a set of displacements which together 
with the edge coordinates in each image can be used to 
re const rue t the edge coordinates for the ent ire bar code 
into a global set of edge coordinates. This global set 
of edge coordinates describes the appearance of the bar 
code, provided that the entire bar code has been imaged. 
Consequent ly , the set of edge coordinates can be used to 
extract 220 the information contents of the bar code, in 
manners well known per se . 

An example of the method is shown in Figs 8a and Sb. 
A bar code 8 01, in this case according to the EAN 13 
Standard , is recorded . The symbol value of the bar code , 
i.e. the information that is to be extracted, is the 
string " 7 2 3 1 4 2 4 3 1 C 0 72 " . Twelve images of trie bar code are 





used to extract the inf ormat ion contents 805 of the bar 
code. This occurs in a manner similar to that of prior- 
art bar code readers. 

The method according to the invention can generally 
be described with the following steps: 

a) capturing by means of the reading device a 
sequence of two-dimensional images of the bar code when 
moving the reading device across the sate; 

b' detecting the edges of the bar code m at least 
a subset of the images; 

c) determining possible displacements in relation to 
the edges of a preceding image for the edges of at least 
a subset of the detected images; 

d) determining the most probable sequence of dis- 
placements for the sequence of images; and 

e 1 ' reconstructing the bar code by means of said 
sequence of images and said most probable sequence of 
displacements . 



